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[57] ABSTRACT 
An image processing apparatus for outputting an image 
which contains different kinds of multi-level signals for 
letters, figures, photographs, screened-halftone, etc. 
The apparatus comprises a screened-halftone pattern 
detecting circuit and a contmuous-tone pattern detect- 
ing circuit for detecting a screened-halftone pattern and 
a continuous-tone pattern, respectively, by using neigh- 
boring pixels of the target pixel, counters for counting 
UP/DOWN in accordance with the outputs of the de- 
tecting circuits, a filter for switching the filtering coeffi- 
cients of the image signal in multiple stages in accor- 
dance with the outputs of the counters and a quantizer 
for bi-level-quantizing the output of the filter. It is thus 
possible to produce an hnage having a good quality free 
from deterioration due to the rapid switching of region 
judgements and bi-level-quantizing methods. 

47 Claims, 10 Drawing Sheets 
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pixels in the blocks in the vicinity of the target pixel is 
IMAGE PROCESSING APPARATUS AND large, the portion is judged to be a binary image portion. 

METHOD FOR MULTI-LEVEL IMAGE SIGNAL Consequently, in the output image, the black hair por- 
tion which is processed by bi-level-quantizing with a 
This application is a continuation of application Ser. S fixed threshold appears in a flat background image 
No. 07/825,973, filed Jan. 27, 1992, now U.S. Pat No. which is smoothed and pseudo-halftoned by the filter, 
5,291,309, issued Mar. 1, 1994. thereby impairing the smoothness of the image. 

BACKGROUND OF THE INVENTION SUMMARY OF THE INVENTION 

1. Field of the Invention 10 Accordingly, it is an object of the present invention 
The present invention relates to an image processing ' to eliminate the above^lescribed problems in the related 

apparatus for bi-level-quantizing a gradated image, art and to provide an image processing apparatus which 

which is stored in digital processing, so as to record and is capable of judging a region and switching the bi-lev- 

display the bi-level-quantized image. el-quantizing method in multiple stages, thereby pro- 

2. Description of the Related Art 15 ducing an image having a good quality free from deteri- 
Various copies are processed in conventional image oration in the output image which is based on rapid 

processing apparatuses such as scanner, copying ma- switching of processing method, 
chine and facsimile. In a binary image region such as To achieve this aim, the present invention provides 
letters, for example, an image is quantized into bi-level an unage processing apparatus for inputting a multi- 
with a fixed threshold so as to make the outline of the 20 level image signal obtained by dectricilly scanning an 
image clear, while in a continuous-tone image region image which contains letters, figures, photographs and 
such as a photograph a dither threshold matrix process- screened-halftone in the form of a mixture and output- 
ing is adopted in order to enhance the gradation repro- ting the multi-level image signal in the form of the hi- 
ducibiUty. level image signal. The image processing apparatus 

In a psgudo halftone region such as sc^egn^-^lf- 25 comprises: a screened-halftone pattern detecting circuit 
J onCj it is ne cessary to subject the refflon to a dither for detecting the screened-halftone pattern by using an 
toeshold matrix proceSng after it is filtered through a image signal in a first vicinity which contains the target 
screened-halftone which suppresses the screened-half- pixel; a screened-halftone counter for coimting the 
tone components in order to prevent moires. screened-halftone pattern detection state on each pixel; 

Many copies such as a catalog have a binary image 30 a continuous-tone pattern detecting circuit for judging 
region such as letters and a continuous-tone image re- whether or not the target pixel is in the continuous-tone 
gion in the form of a mixture. In this case, it is necessary region by using an image signal in a second vicuiity 
to distinguish each region and to subject each region to which contains the target pixel; a continuous-tone 
an appropriate processing before outputting it counter for counting the continuous-tone pattern detec- 

As such processings, Japanese Patent Laid-Open No. 35 tion state on each pixel; a filter for filtering the image 
Sho 58-3374 discloses a method of distinguishing a bi- signal of the target pixel gradually on the basis of differ- 
nary image region from a continuous-tone image region ent characteristics in accordance with either or both of 
■ hy-Ah i H i wt rigTTTy TmHdniiiTTT liimwTgTTS gfl fti! thik minitn uTTi the outputs of the two counters; and a means for bi-lev- 
luminance of the pixels in a block, Jaj^es ^ Patent Lai d- el-quantizing the output of the filter. 
^^M^J^ Sh£i-6 ^*i7f{n d isclnse^g^lTiethod of distin- 40 In an image processing apparatus according to the 
guishing regions in screened-halftone printing byTob- present invention, the filtering coefficient^iucb-'as-^ 
taining the difference in an average luminance of the smoothing coefficient^(i'a"coefficiefirorhigh resolu- 
pixels in a plurality of surrounding blocks, and Japanese tion frequency intensification and a bi-level-quantizing 
Patient Laid-Open No. Hei 2-112077 discloses a method method are gradually switched in accordance with the 
of distinguishing the regions on the basis of the number 45 outputs of the two counters for counting the screened- 
of pixels which constitute the peak or the trough of the halftone pattern detection state and the continuous-tone 
curve of a gradation change in a block. pattern detection state on the basis of the outputs of the 

Japanese Patent Laid-Open Nos. Sho 64-57877, Hei screened-halftone pattern detecting circuit and the con- 
2-112077 and Hei 2-115987 disclose a technique of de- tinuous-tone pattern detecting circuit which detect the 
tecting screened-halftone pattern pixels by using infor- 50 screened-halftone pattern and the continuous-tone pat- 
mation on the regions surrounding the target pixel. tern, respectively, by using image signals in the vicinity 

None ofjhes o conventional m efeods,..bowevcFr-can of the target pixel. Accordingly, it is possible to pro- 
rSalizeThe ideal discrimination of the regions, and duce a processed image having a high quahty free from 
greatly deteriorate the picture quality on the boundary deterioration caused by the rapid switching of process- 
of different regions at the time of bi-level-quantizing. 55 ing methods. 

For example, the portion having a high resolution fre- The above and other objects, features and advantages 
quency component such as an eye and hair in a portrait of the present invention will become clear from the 
isjudgedtobeabinary image region because the differ- following description of the preferred embodiments 
ence in the maximum luminance and the minimum lumi- thereof, taken in conjunction with the accompanying 
nance in the decision block containing that portion 60 drawings. 

becomes locally large As a result, in the output bmary dESCRIFHON OF THE DRAWINGS 

miage, a bi-level-quantized unage portion With a fixed "^^^ x^i-c.v,xx*i xxv^i^ 

threshold with an intensified contrast suddenly appears FIG. 1 is a block diagram of an embodiment of an 
in a smooth pseudo halftone image. image processing apparatus according to the present 

In screened-halftone printing, in the portion in which 65 invention; 
the luminance level greatly changes such as the portion FIG. 2(a) and FIG. 2(6) are an explanatory view of 
at which a gray background changes into black hair, an example of patterns detected by a screened-halftone 
since the difference in the average luminance of the pattern detector 3^ in the embodiment shown in FIG. 1, 
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wherein FIG. 2(a) includes examples of screened-half- mensional filter for filtering the target pixel while vary- 

tone pattern, and FIG. 2{b) includes examples of non- ing the characteristic in accordance with the signal 

screened-halhone pattern; output from the region judging and controlling circuit 

FIG. 3 is an explanatory view of a method of switch- 8. The reference numeral 10 denotes a dither matrix 

ing a bi-level-quantizing method on the basis of a filter 5 signal generator for generating a dither matrix signal on 

and a dither threshold matrix in the embodiment shown the basis of the horizontal position and the vertical 

in FIG. 1; position of the target pixel for the purpose of pseudo 

FIG. 4(fl), FIG. 4(b), FIG. 4(c), FIG. ^d) and FIG. halftone processing, 11 a multipher for receiving a sig- 

4(e) show the characteristics of the filter used in the nal firom the region judging and controlling circuit 8 

embodiment shown in FIG. 1; 10 and multiplying the dither matrix signal output from the 

FIG. 5 is an explanatory view of the dither matrix dither matrix signal generator 10 by a predetermined 

signal used in the embodiment shown in FIG. 1; coefficient of 1 to 0, and 12 an adder for adding the 

FIG. 6 is a block diagram of another embodiment of output of the multiplier 11 and the output of the filter 9. 

an image processing apparatus according to the present The reference numeral 13 represents a quantizer for 

invention; 15 bi-levd-quantizing the output of the adder 12 on the 

FIG. 7 is a block diagram of a bi-level-quantizing basisof a fixed threshold value and supplymg the binary 

portion in still another embodiment of an image pro- output. 

cessing apparatus according to the present invention; As shown in FIG. 1, the continuous-tone pattern 

FIG. 8 is an explanatory view of of a coefficient of detecting circuit 3 is composed of a maximum lumi- 

error weighting addition in the embodiment shown in 20 nance detector 3c for receiving the output of the image 

FIG. 7, which presents a direction of scanning, and a signal register 2 and obtaining the maximum luminance 

target pixel shown cross-hatched; and in the decision block which is composed of 3 lines X 5 

FIG. 9 is an explanatory view of a method of switch- horizontal pixels, a minimum luminance detector 3^ for 

ing a filter and a bi-level-quantizing method on the basis obtaining the minimum luminance, an average lumi- 

of an error diffusion method in the embodiment shown 25 nance detector 3c for obtaining the average luminance, 

in FIG. 7. a subtracter Zd for obtaining the difference between the 

T-trc utjr:T7t?i>i>r7r* maximum luminance output and the minimum lumi- 

DESCRIFTION OF THE PREFERRED output, a comparator 3e for comparing the output 

EMBODIMENTS ^he image signal register 2 with the output of the 

The present invention will be explained hereinunder 30 average luminance detector 3c; a comparison result 

with reference to the illustrated embodiments. It is here register 3/for receiving the output of the comparator 3e 

assumed that the image signal input to the image pro- and temporarily storing the comparison result of 3 li- 

cessing apparatus has 0 to 255 levels, namely, 256 levels nesX 5 horizontal pixels, and a screen ed-halftone pa t- 

in total and a white signal has a level 255 and a black tern detector Zg for receiving Ste-otltput of the su^ 

signal has a level 0. A white signal is output as "1" and 35 tracter 3d and the output of the comparison result regis- 

a black signal as **0". ter 3/ ATifi mitpnttiTi^ the result of the detection of the 

FIG. 1 shows an embodiment of the present inven- s creene^ -fiftiftgyi? p^^t^TP 

tion. In FIG. 1, the reference numeral 1 represents an TKe^ontinuous-tone pattern detecting circuit 6 is 
image memory for temporarily storing an input image composed of not only the maximum luminance detector 
signal, and 2 an image signal register for receiving the 40 3a, ihc minimum luminance detector 3b and the sub- 
input image signal and the output of the image memory tracter 3d which are also incorporated into the 
1 and delaying the image signal and the output of the screened-halftone pattern detecting circuit 3, but also a 
image memory by predetermined pixel clocks so as to continuous-tone pattern detector 6a for receiving the 
make a decision image signal block of 3 lines X 5 hori- output signals from these detectors 3c, 3b and subtracter 
zontal pixels in the vicinity of the target pixel. The 45 3d and outputting t he result of the detection o f the 
reference numeral 3 denotes a screened-halftone pattern contmUOUii-LUttfe p4ltfem! 

detecting circuit for detecting the screened-halftone The operation of this embodiment will be explained 

pattern from the decision image signal block of the hereinunder. 

register 2, and 4 a screened-halftone counter for receiv- When an unage signal is input, the signal on a first line 

ing the output of the detecting circuit 3 and the judged 50 is first stored in tie image memory 1 . When an image 

value judged on one line before by a screened-halftone agnal on a sg cQudJiBe- is sup p lied ^ the image signal on 

region judging memory 5 and counting the screened- one line before is read out as Ihe target line sign al and 

halftone detection state. The screened-halftone region the-signal-on-iwo^feesZBgo^ 

judging memory 5 temporarily stores the output of the s!f&aHs-oait^jf-tii©4FMac^oF3i[rcbpy, it becomes a total 

screened-halftone counter 4 until an image signal on the 55 white signal) is read out as the previous line signal, and 

next line is output. The reference numeral 6 represents these signals are supplied to themagc-^ignal register 2 

a continuous-tone pattern detecting circuit for detecting together with the current image signal ^whicn oecomes 

the continuous-tone pattern ft-om the decision image the image signal on the next line) on the second line. At 

signal block of the image signal register 2, and 7 a con- this time, the image signal on the second" line is written 

tinuous-tone counter for receiving the output of the 60 in the image memory 1 so as to be used in the next line 

detecting circuit 6 and counting the continuous-tone processing. 

detection state. The image signal register 2 receives the image signals 

The reference numeral 8 represents a region judging on these three lines and delays them by predetermined 
and controlling circuit for judging in which region of pixel clocks so as to generate a decision image signal 

the letter and figure region, the photograph (continu- 65 block of 3 lines X 5 horizontal pixel & including the target 

ous-tone) region and the screened-halftone region the jixel at the center . From this.bjpck, the_screened-half- 

target pixel is on the basis of the outputs of these count- tone pattern detecting circuit 3 generates a maximum 

ers 4 and 7. The reference numeral 9 denotes a two-di- luminance signal^ a minimum luminance signal and a 
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difference signal by the maximiiTn laminance detector 
3a, the minimntn luminance detector 3^ and the sub- 
tracter 3d respectively. The average luminance is de- 
tected by the average luminance detector 3c and the 
comparator Ze con^ares each image signal of the 3 5 
line X 5 horizontal pixels with the average luminance 
and supplies the result of comparison to the comparison 
result register 3/ The comparison result register 3 / 
stores the result of comparison of each pixel with the 
average luminance in the block of 3 lines X 5 horizontal 10 
pixels including the target pixel at the center and 
supplies the stored result to the screened-halftone pat- 
tern detector 3g. 

Jhe screened-halftone pattern detector Jgil etects the 
screened-halftone pattern by using the output of the 15 
difTerence between the maximum luminance and the 
minimum luminance of the image signal of the 3 li- 
nes X 5 horizontal pixels including the target pixel at the 
center, namely, the output of the subtracter 3^ and a 
preset threshold value THl (ordinarily about 96) under 20 
the following conditions: 

when the difference signal of the subtracter 3</>THl 
and 

the comparison result signal of the comparison result 
register 3/ agrees with any of the patterns shown in 25 

the output signal of the screened-halftone patt«n 
detrotor 3g is "screened-halftone", and 
^ tfieTrtfagP ;as es, 

ou^ut signal ol the screened-halftone pattern 3i 
[etector Sgis "non-screened-halftone". 

e patterns shown m tli}. 2(a) are patterns which 
are generated with high frequency when the target 
pixel is situated in the vicinity of the center of a white or 
black dot of each screened-halftone pattern in the case 35 
of reading screened-halftone composed of 65 to 100 
lines, which are used for ordinary printed matter 
(screened-halftone composed of 150 lines or more are 
read out as a continuous-tone signal, so that the detec- 
tion of them as screened-halftone is unnecessary), at a 40^ 
rate of 8 pixels/mm and which are scarcely generated 
when an ordinary letter and figure image is read out. 
The condition on the output signal of the subtracter 3d 
is designated in order to prevent a noise pattern gener- 
ated when the background portion of a copy is quan- 45 
tized into bi-level on the basis of the average luminance 
from being judged to be a screened-halftone pattern by 
mistake. Due to this pattern detection, it is possible to 
detect a screened-halftone pattern in almost all the pix- 
els in the vicinity of the center of the screened-halftone 50 
in a screened-halftone ima ge and to greatly reduce the 
j alse det ection of a screenea-tiaiftonfi p attern m a letter 
^d fagute IMgfi. 



of target pixel is corrected to the value substracted "1" 
from the count value which has counted about the pixel 
and at the same horizontal position of previous line. The 
count value is limited to 0 to 15 and even if there is a 
possibility of the count value exceeding this range, the 
count value is restricted to this range. The count value 
of the screened-halftone counter 4 indicates the 
screened-halftone pattern detection state, and if the 
value is large, it means that many screened-halftone 
patterns are detected. JB_othftr wnrriSj th^rf* is n high- 



possibility of the targ etpixel byrfg in the screened-half^i 
"^nf egion ( thi o ^ggtris hereinunder referred to as "T , 
sfete haviifg a tCTgh degree of screened-halftone detect 
tion"). 

By this procedure, the output of the screened-half- 
tone pattern detector 3g for detecting the screened-half- 
tone pattern which generates discretely in the screened- 
halftone image region is smoothed and the entire part of _ 
the screened-halftone image re gion assunie s a state hav- 
tg a high degree of screened-nalttone detection, while 
Ibe-output of the scr^nftfl'^"^^^"^ T^P^^ ripfprtnc^ag^ 
which det ects ^ screened-halftone pattern in the le tter 
and figure re gion by mistake is ^alsg.s mootheci'a59 The'" 
Tetter and figx Ut itgiuu leiiS I^I^I^e- having iu 




i ne screened-halftone counter 4 receives the output 
of the screened-halftone pattern detector 3 and the 55 
count value (in this case, since the previous hne is out of 
the frame of the copy, the count value is 0) of the 
screened-halftone counter 4 which has counted about 
the pixels on one line before and at the same horizontal 
position from the screened-halftone region judging 60 
memory 5, and adds "4" to the count value when the 
output signal of the screened-halftone pattern detector 
3g is "screened-halftone", and subtracts "1" therefrom 
when the output signal is "non-screened-halftone". 

If the count value which has counted about the pixel 65 
at the same horizontal position of previous line from the 
screened-halftone region judging memory 5 exceeds the 
renewed count value of the target pixel, ^e count value 



degree of screened-fiautone detection. 

The conGnuous-tQue pattern detectifag circuit 6 de- 
tects the continuous-tone pattern by the continuous- 
tone pattern detector 6a using the maximum luminance 
signal of the 3 lines'5 horizontal pixels, the minimum 
luminance signal and the difference signal output from 
the maximiirp luminance detector 3a; the tninimnm lu- 
minance detector 3^ and the subtracter Zd, respectively, 
and on the basis of preset threshold values TH2 (ordi- 
narily about 64), TH3 (ordinarily about 8) and TH4 
(ordinarily about 240) under the following conditions: 

when the difference signal of the subti^cter 

the Tnaximnm luminance >TH3, and 

the minimTUT ]^ luminance ^ Tlj4; 

die output signal of the continuous-tone pattern detec- 

> "continuous-tone", and 

the oihe r caset ; , " 

the output signal of the contmuous-tone pattern de- 
tector 6a is "non-continuous tone". 

The c^nditiop on the difference signal of the sub- 
tracter 3d is designated in order to detect a continuous- 
tone pattern in the continuous-tone pattern region in 
which the signal difference in the small region is small, 
and the conditions on the ma ximnTn luminance and the 
minimum luminance is designated in order to prevent 
the blurred portion in the background and^ the letter 
portion from being judged to be a continuous-tone por% 
tion by mistake. ^ 

The continuous-tone counter 7 adds 2 to the count 
value when the detection signal of the continuous-tone 
pattern detector 6a is "continuous-tone", and subtracts 
1 therefrom when the detection signal is "non-continu- 
ous-tone". The counted value is limited to 0 to 7 and 
even if there is a possibility of the count value exceeding 
this range, the count value is restricted to this range. 
The count value indicates the continuous-tone pattern 
detection state, and if the value is large, it means that 
many continuous-tone patterns are detected. In other 
words, there is a high possibihty of th^) target pixel 
being in the halftone region (this state is^ hereinunder 
referred to as "a state having a high degree of halftone 
detection*'). 
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The region judging and controlling circuit 8 receives an eye or the black hair in a portrait, or a portion at 
theoutputsof the two counters 4» 7 and judges in which which a gray background changes to black hair in 
region of the letter and figure region^ the photograph screened-halftone printing is subjected to continuous 
(continuous-tone) region and the screened-halftone re- pseudo halftone processing by using a dither threshold 
gion the target pixel is, and supplies a control signal to S matrix or pseudo halftone processing after being fdtered 
the filter 9 and the multiplier 11 in accordance with the through a moire removing filter, it is possible to pro- 
control table shown in FIG. 3. duce a bi-level-quantized image having a good quality 

FIG. 4 shows the characteristics of the filter 9 in the free from deterioration which is caused by a conven- 
table shown in FIG. 3. The position of the center pixel tional apparatus due to the rapid switching of process- 
in a 3 X 3 matrix is assumed to be a coefficient of the 10 ing metiiods. 

target pixel and a coefficient of each of the pixels sur- FIG. 6 shows another embodiment of the present 
roimding the center pixel is shown. FIG. 4(fl) shows a invention. The elements which are the same as those 
filter which needs no correction, FIGS. A(b) to 4(d) shown in FIG. 1 are indicated by the same numerals 
show low pass filters for removing a screened-halftone prefixed by the numeral 1, and explanation thereof will 
frequency component (a moire removing filter) and 15 be omitted. In this embodiment, a screened-halftone 
FIG. 4{e) shows a Laplacian filter for correcting the judging memory 105 stores the output of a scrdened- 
apcrture effect by a sensor, halftone pattern detector 103g in place of the od^ut of 

The dither matrix signal generator 10 generates a a counter 104. The screened-halftone judging memory 
dither matrix signal shown in FIG. 5 depending upon at . 105 stores the outputs of the screened-halftone pattern 
what position in the matrix of 4X4 pixels on the copy 20 detector 103g for 2 lines, and a screened-halftone regis- 
the target pixel is situated. That is, in FIG. 5, an image ter 22 holds the outputs of the screened-halftone pattern 
signal is divided into 4x4 pixels and the dither matrix detector 103g for 3 lines X 3 horizontal pixels including 
signal corresponding to each pixel is shown. The multi- the target pixel at the center and counts by using these 
pher 11 multiplies the output of the dither matrix signal outputs. 

generator 10 by a coefficient shown in FIG. 3 and the 25 In this case, when the "screened-halftone" pixel exists 
adder 12 adds the output of the multipUer 11 to the in the 3 lines X 3 horizontal pixels, *'the number of pix- 
output of the filter 9. The quantizer 13 quantizes the els X 2" is added to the count value, while no "screened- 
output of the adder 11 into bi-level on the basis of a halftone" pixel exists therein, "1" is subtracted from the 
fix^ threshold value and finally outputs the binary count value. 

output as a binary output from the image processing 30 Since the target pixel becomes the pixel on one line 
apparatus of the present invention. after, as explained above with respect to the^pixel signal 

As a result, when the outputs of the counters 4 and 7 register, memories 23, 24 for delaying the target pixel 
are both **0", for example, the image signal with the by one line before the respective processings by a filter 
high resolution frequency component intensified by the 109 and a continuous-tone counter 107 are provided, 
filter 9 as a lett er and figure image is simp ly q^^antigaH 35 FIG. 7 shows a bi-level-quantizing portion in still 
into bi-levei witn a iixed threshol d.b y the q nantiTer 13. another embodiment of an image processing apparatus 
When the UUipui~Ot tne screenea-nainone cdunter-4TS* according to the present invention. The elements which 
"15" and the output of the halftone counter ^7_.is-^"0*', are the same as those shown in FIG. 1 are indicated by 
a fter the screen ed-halftone fr^uengy oompnneBt- is the same numerals prefixed by the numeral 2, and expla- 
removed thrnygh the fihgrTT^dithftr matr ix sii^al is^ 40 nation thereof will be omitted. In FIG. 7, the reference 
a dded to the output^ d t he binary signal thus subjected numeral 25 denotes a register for storing a later- 
to pseuao naittone processing is outpu t. Un tne other described quantizing error with respect to a neigfabor- 
^and,~when the output of the screened-halftone counter ing pixel, 26 a weighting adder for weighting the quan- 
4 is •*0" and the output of^thecontinupusrtone counter 7. tizing error signal by a predetermined coefficient shown 
is "7", the output signal of the image signal register 2 is 45 in FIG. 8, 27 a multipher for multiplying the addition 
output as U is through the filter 9, and a dither matrix signal by a predetermined coefficient of 0 to 1 in accor- 
5i gnal is added to t h e output nnd thr binar i ' nignal thin dance with the control signal from a region judging and 
^bjected to pseudo halftone processing is output controlling circuit 208, 28 an adder for adding the out- 

The ab6ve-aescnbed proccssmg is repeated in each put of an adder 212 and the output of the multiplier 27, 
pixel to the end of the line. In this way, the bi-level- 50 29 a re-quantizer for converting the binary ou^ut "0" 
quantized image signal on the first line is output. There- or "1" supplied-froa^-a-qua ntizer 21 3^into a level of "0" 
after, an image signal on a third line is supplied and the or "255", 30 a subtracter for subtracting the output of 
image signal on the second line is processed in the same the re-quantizer 29 from the input of the quantizer 213 
way. Similar processing is executed on each line to the so as to generate a quantizing error signal, and 31 an 
end of the page. 55 error memory for temporarily storing the quantizing 

In processing the image signal on the last line, since error signal, 
the image signals on all the lines have already been input This embodiment is provided with a bi-level-quantiz- 
to the image processing apparatus, a total white signal ing portion having the above-described structure, and 
for ■a^i fenal out of the frame of the^( Sopv-jFused as the ' adopts an error diffusion method including a process of 
data on the next tine. 60 weighting and adding a dither matrix signal and an 

As described above, in this embodiment, the filtering error signal. FIG. 9 shows the coefficients of a filter 
coeffiCTaarsuch-as-y smootfam g:g)emcieniiuid-^^ — 209, a dither matrix signal multipUer 211 and a 
cjient.of-high resolution frequency component intensifi- weighting error signal multipUer 27. By this control, it 
cation and the degree of superimposing a dither matrix is possible to produce a bi-level-quandzed image having 
signal are switched in multiple stages in accordance 65 a good quaUty. 

with the count values of the screened-halftone counter In these embodiments, a method of detecting a 
4 and the continuous-tone counter 7. Since a pordon screened-halftone pattern by the pattern matching of an 
having a high resolution frequency component such as image signal of 3 lines X 5 horizontal pixels which is 
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bi-levd-quantized on the basis of an average luminance 
m the screened-halftone pattern detecting circuit 103 
(203) is adopted The same effects are produced by 
adopting a method of judging a screened-halftone pat- 
tern from the number of turning points in the horizontal 
direction and the vertical direction of a binary signal 
such as that described in ''Distinguishing and Process- 
ing Method in Halftone Dot Photograph", by Ibaraki, 
Kobayashi and Ochi, The Journal of The Institute of 
Electronics, Information and Communication Engineers 
(1987), Vol. J70-B, No. 2, pp. 222 to 232. 

Although the same neighboring pixels are used to 
detect a screened-halftone and a continuous-tone in 
these embodiments, different neighboring pixels may be 
used. 

In addition, although a pattern is detected for each 
pixel in series in these embodiments, an image signal 
may be divided into several blocks each consisting of N 
(e.g., 5) pixels and a pattern may be detected in each 
block in order to reduce the number of processings. The 
result of detection is adapted to N pixels of the target 
line. This processing is called a serial line and pixel 
block processing. 

It is also possible to divide an image signal into sev- 
eral blocks each consisting of N lines and N pixels, 
thereby enabling block processing in both vertical and 
zontal directions. ^ 
All processings are realized in a hardware in these 
embodiments, but they may be executed in a software 
by using a CPU. 

Tdescribed above, according to the present inven- 
tion, two detecting circuits for detecting a screened- 
halftone pattern and a continuous-tone region pattern 
by using a neighboring pixel signal of the target pixel, 35 
and two counters for counting UP/DOWN in accor- 
dance with the outputs of the detecting circuits are 
provided, and the filtering coef&cient such as a smooth- 
ing coefficient and a coefficient of high resolution fre- 
quency component intensification and the bi-level- 
quantizing method are switched in multiple stages in 
accordance with the outputs of the counters. It is thus 
possible to realize an image processing apparatus which 
produces an image having a good quality free from 
deterioration due to the rapid switching of bi-level- 
quantizing methods. 

While there has been described what are at present 
considered to be a preferred embodiments of the inven- 
tion, it will be understood that various modifications 
may be made thereto, and it is intended that the ap- 
pended claims cover all such modifications as fall 
within the true spirit and scope of the invention. 
What is claimed is: 

1. An image processing apparatus for inputting a 
multi-level image signal including a succession of pixels 55 
obtained by electrically scanning an image which con- 
tains letters, figures, photographs and screened-halftone 
in the form of a mixture and outputting the multi-level 
image signal, the image processing apparatus compris- 
ing: 

A) a screened-halftone pattern detecting circuit for 
detecting the screened-halftone pattern by using an 
image signal which represents a first vicinity of the 
image which contains a target pixel in the succes- 
sion of pixels; 

B) a screened-halftone smoothing circuit responsive 
to the screened-halftone pattern detection state on 
each pixel in the succession of pixels; 
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C) a continuous-tone pattern detecting circuit for 
judging whether or not the target pixel is in the 
continuous-tone region by using an image signal 
which represents a second vidnity of the image 
which contains the target pixel; 

D) a continuous-tone smoothing circuit responsive to 
the continuous-tone pattern detection state on each 
pixel in the succession of pixels; and 

£) a fUter for filtering the image signal of the target 
pixel on the basis of characteristics in accordance 
with either or both of the outputs of the two 
smoothing circuits. 

2. The apparatus of claim 1 further including a bi-lev- 
d-quantizing circuit responsive to the output of the 
filter. 

3. An image processing apparatus according to claim 
2, wherein the bi-level-quantizing circuit includes a 
means for bi-levd-quaatizing the output with a fixed 
threshold and a means for bi-level-quantizing the output 
by using an ordered dither threshold matrix. 

4. An image processing apparatus according to claim 
2, wherein the bi-level-quantizing circuit includes a 
means for bi-levd-quantizing the output by using an 
error diffusion method. 

5. An image processing apparatus according to any of 
claims 1 to 3, wherein at least one of the circuits in- 
cludes a region judging memory for temporarily storing 
the pattern detection state so that the smoothing circuit 
smoothes on the basis of the output of the region judg- 
ing memory. 

6. An image processing apparatus according to claim 
1, wherein the screened-halftone pattern detecting cir- 
cuit includes: 

a maximum luminance detector for obtaining the 
maximum luminance in a decision pixd block; 

a minimum luminance detector for obtaining the min- 
imum luminance in the decision pixd block; 

an average luminance detector for obtaining the aver- 
age luminance in the decision pixel block; 

a subtracter for obtaining the difference between the 
fTTaTiTTmm luminance and the minimum luminance; 

a comparator for comparing the luminance of each 
pixel with the average luminance; 

a comparison result register for temporarily storing 
the output of the comparator; and 

a screened-halftone pattern detector for detecting a 
screened-halftone pattern from the output of the 
subtracter and the output of the comparison resxilt 
register. 

7. An image processing apparatus according to claim 
1, wherein the continuous-tone pattern detecting circuit 
includes: 

a maximum luminance detector for obtaining the 
maximum luminance in a decision pixel block; 

a minimum luminance detector for obtaining the min- 
imum luminance in the decision pixel block; 

a subtracter for obtaining the difference between the 
maximum luminance and the minimum luminance; 
and 

a continuous-tone pattern detector for detecting a 
continuous-tone pattern on the basis of the outputs 
of the TnaTiTnum luminance detector, the minimnTTx 
luminance detector and the subtracter. 

8. An image processing apparatus according to claim 
1, wherein the screened-halftone pattern detecting cir- 
cuit and the continuous-tone pattern detecting circuit 
include in common a maximum luminance detector for 
obtaining the mflTiTnnTn luminance in a decision pixel 
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block, a minimum luminance detector for obtaining the 
minimum luminance in the decision pixel block and a 
subtracter for obtaining the difference between the 
maximum luminance and the minimum luminance- 

9. An image processing apparatus according to claim 
2, wherein the bi-level-quantizing means includes; 

a register for storing a quantizing error with respect 
to a neighboring pixel; 

a weighting adder adding a predetermined weighting 
to a quantizing error; 

a multiplier for miiltiplying an addition signal by a 
predetermined coefficient of 0 to 1 m accordance 
with the control signal from a region judging an 
controlling circuit; 

an adder for adding the output of the weighting adder 
and the output of the multiplier; 

a quantizer for quantizing the output of the adder, 

a re-quantizer for converting the output of the quan- 
tizer into a different level; 

a subtracter for subtracting the output of the re-quan- 20 
tizer from the input of the quantizer so as to gener- 
ate a quantizing error signal; and 

an error memory for temporarily storing the quantiz- 
ing error signal. 

10. The apparatus of claim 1 wherein the smoothing 25 
circuits are both counters. 

11. An image processing method for processing a 
multi-level image signal including a succession of pixels 
obtained by electrically scanning an image which con- 
tains letters, figures, photographs and screened-halftone 30 
in the form of a mixture and outputting the multi-level 
image signal, the image processing method comprising: 

detecting the screened-halftone pattern using an 
image signal which represents a first vicinity of the 
image which contains a target pixel in the succes- 35 
sion of pixels; 

smoothing the results of the step of detecting; 

judging whether or not the target pixel is in the con- 
tinuous-tone region by using an image signal which 



temporarily storing the results of the step of compris- 
ing; and 

detecting a screened-halftone pattern from the result 
of the step of obtaining the difference and the result 
of the step of temporarily storing. 

17. The method of claim 11, wherein the step of judg- 
ing includes: 

obtaining the maximum luminance in a decision pixel 
block; 

obtaining the miTiiTnum luminance in the decision 
pixel block; 

obtaining the difference between the maximum lumi- 
nance and the Tnir^Tmppri luminance; and 

detecting a continuous-tone pattern on the basis of 
the results of the step of obtaining the maximum 
and the results of the step of obtaining the mini- 
mum an the results of the step of obtaining the 
difference. 

18. An image processing apparatus for inputting a 
multi-level image signal including a succession of pixels 
obtained by electrically scanning an image which con- 
tains letters, figures, photographs and screened-halftone 
in the form of a mixture and outputting the multi-level 
image signal, the image processing apparatus compris- 
ing: 

a screened-halftone pattern detecting circuit for de- 
tecting the screened-halftone pattern in the multi- 
level signal; 

a screened-halftone smoothing circuit responsive to 
the screened-halftone pattern detecting circuit; 

a continuous-tone pattern detecting circuit for detect- 
ing the continuous-tone pattern in the multi-level 



represents a second vicinity of the image which 40 circuits are both counters. 



a continuous-tone smoothing circuit responsive to the 

continuous-tone pattern detecting circuit; and 
a filter for filtering the image signal on the basis of 
characteristics in accordance with either or both of 
the outputs of the two smoothing circuits. 
19. The apparatus of claim 18 wherein the smoothing 



contains the target pixel; 
smoothing the results of the step of judging; and 
filtering the image signal of the target pixel gradually 
on the basis of different characteristics in accor- 
dance with either or both of the results of the two 45 
steps of smoothing. 

12. The method of claim 11 further including the step 
of bi-level-quantizing the results of the step of filtering. 

13. The method of claim 12, wherein the step of bi- 



20. The apparatus of claim 18 further including a 
bi-level-quantizing circuit responsive to the output of 
the filter. 

21. An image processing apparatus according to 
claim 20, wherein the bi-level quantizing circuit in- 
cludes a means for bi-level-quantizing the output with a 
fixed threshold and a means for bi-level-quantizing the 
output by using an ordered dither threshold matrix. 

22. An image processing apparatus according to 



level-quantizing includes bi-level-quantizing the results 50 claim 20, wherein the bi-level-quantizing circuit in- 



with a fixed threshold and bi-level-quantizing the results 
using an ordered dither threshold matrix. 

14. The method of claim 12 wherein said step of bi- 
level-quantizing bi-level-quantizes the results by using 
an error diffusion method. 55 

15. The method of any of claim 11 to 14, wherein the 
smoothing is performed on the basis of the output of a 
region judging memory. 

16. The method of claim 11, wherein the step of de- 
tecting includes: 60 

obtaining the maximum luminance in a decision pixel 
block; 

obtaining the average luminance in the decision pixel 
block; 

obtaining the difference between the maximiim lumi* 65 
nance and the minimum luminance; 

comparing the luminance of each pixel with the aver- 
age luminance; 



eludes a means for bi-level-quantizing the output by 
using an error diffusion method. 

23. An image processing apparatus according to 
claim 20, wherein the bi-level-quantizing circuit in- 
cludes; 

a register for storing a quantizing error with respect 
to a neighboring pixel; 

a weighting adder adding a predetermined weighting 
to a quantizing error; 

a multiplier for multiplying an addition signal by a 
predetermined coefficient of 0 to 1 in accordance 
with the control signal ftom a region judging an 
controlling circuit; 

an adder for adding the output of the weighting adder 
and the output of the multiplier; 

a quantizer for quantizing the output of the adder; 

a re-quantizer for converting the output of the quan- 
tizer into a different level; 
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a subtracter for subtracdng the output of the re-quau- 
tizer from the input of the quantizer so as to gener- 
ate a quantizing error signal; and 

an error memory for temporarily storing the quantiz- 
ing error signal. S 

24. An image processing apparatus according to any 
of claims 18 to 23, wherein at least one of the smoothing 
circuits includes a region judging memory for tempo- 
rarily storing the pattern detection state so that the 
smoothing circuit smoothes on the basis of the output of 10 
the region judging memory. 

25. An image processing apparatus according to 
claim 18, wherein the screened-balftone pattern detect- 
ing circuit includes: 

a maxiTnum luminance detector for obtaining the 
maximum luminance in a decision pixel block; 

a minimiiTTi luminance detector for obtaining the min- 
imum luminance in the decision pixel block; 

an average luminance detector for obtaining the aver- 
age luminance in the decision pixel block; ^® 

a subtracter for obtaining the difference between the 
TnflT imnm luminance and the mininrmTTi luminance; 

a comparator for comparing the luminance of each 
pixel with the average luminance; 

a comparison result register for temporarily storing 
the output of the comparator; and 

a screened-halftone pattern detector for detecting a 
screened-halftone pattern from the output of the 
subtracter and the output of the comparison result 
register. 

26. An image processing apparatus according to 
claim 18, wherein the continuous-tone pattern detecting 
circuit includes: 

a maximum luminance detector for obtaining the 33 
maximum luminance in a decision pixel block; 

a minimum luminance detector for obtaining the min- 
imum luminance in the decision pixel block; 

an average luminance detector for obtaining the aver- 
age luminance in the decision pixel block; 4Q 

a subtracter for obtaining the difference between the 
maximum luminance and the minimum luminance; 
and 

a continuous-tone pattern detector for detecting a 
continuous-tone pattern on the basis of the outputs 4.5 

of the Tnaximum luminance detector, the minirrmm 

luminance detector and the subtracter. 

27. An image processing apparatus according to 
claim 18, wherein the screened-halftone pattern detect- 
ing circuit and the continuous-tone pattern detecting 50 
circuit include in common a mflTimi im luminance detec- 
tor for obtaining the maximum luminance in a dedsion 
pixel block, a minimum luminance detector for obtain- 
ing the minimum luminance in the decision pixel block 
and a subtracter for obtaining the difference between 55 
the maT cimnm luminance and the Tninifnnm luminance. 

28. An image processing method for processing a 
multi-level image signal including a succession of pixels 
obtained by electrically scanning an image which con- 
tains letters, figures, photographs and screened-balftone 60 
in the form of a mixture and outputting the multi-level 
image signal, the image processing method comprising: 

generating a first signal indicating a likelihood that 
the multi-level image signal represents a screened- 
balftone region, 65 

generating a second signal indicating a likelihood that 
the multi-level image signal represents a continu- 
ous-tone region. 



processing the multi-level image signal using a plural- 
ity of methods simultaneously, 

adjusting a first of the methods in accordance with 
the first and second signals generated in each of the 
steps of generating, and 

adjusting a second of the methods in accordance with 
the fii^t and second signals generated in each of the 
steps of generating. 

29. TTie method of claim 28 wherein the step of pro- 
cessing uses filtering as the first method and wherein the 
step of adjusting a first of the methods adjusts the char- 
acteristics of the filtering. 

30. The method of claim 28 wherein the step of pro- 
cessing uses dithering as the first method and wherein 
the step of adjusting a first of the methods adjusts the 
amplitude of the dithering. 

31. The method of claim 30 wherein the step of pro- 
cessing uses filtering as the second method and wherein 
the step of adjusting a second of the methods adjusts the 
characteristics of the filtering. 

32. The method of claim 28 further including the step 
of bi-level-quantizing the results of the step of filtering. 

33. The method of claim 32, wherein the step of bi- 
level-quantizing includes bi-level-quantizing the results 
with a fixed threshold and bi-level-quantizing the results 
using an ordered dither threshold matrix. 

34. The method of claim 32 wherein said step of bi- 
level-quantizing bi-level-quantizes the results by using 
an error diffusion method. 

35. The method of any of claim 28 to 34, wherein the 
smoothing is performed on the basis of the output of a 
region judging memory. 

36. The method of claim 28, wherein the step of de- 
tecting includes: 

obtaining the maximum luminance in a decision pixel 
block; 

obtaining the average luminance in the decision pixel 
block; 

obtaining the difference between the maximum lumi- 
nance and the TninimnTTi luminance; 

comparing the luminance of each pixel with the aver- 
age luminance; 

temporarily storing the results of the step of compar- 
ing; and 

detecting a screened-halftone pattern from the result 
of the step of obtaining the difference and the result 
of the step of temporarily storing. 

37. The method of claim 28, wherein the step of judg- 
ing includes: 

obtaining the maximum luminance m a decision pixel 
block; 

obtaining the tnininniTn luminance in the decision 
pixel block; 

obtaining the difference between the maximum lumi- 
nance and the nii n imum luminance; and 

detecting a continuous-tone pattern on the basis of 
the results of the step of obtaining the maximum 
and the results of the step of obtaining the mini- 
mum and the results of the step of obtaining the 
difference. 

38. An image processing apparatus for inputting a 
multi-level image signal including a succession of pixels 
obtained by electrically scanning an image which con- 
tains letters, figures, photographs and screened-halftone 
in the form of a mixture and outputting the multi-level 
image signal, the image processing apparatus compris- 
ing: 
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screened-halftone pattern detecting means for detect- 
ing the screened-halftone pattern by using an image 
signal which represents a first vicinity of the nnage 
which contains a target pixel in the succession of 
pixels; S 

screened-halftone smoothing means for smoothing 
the screened-halftone pattern detection state on 
each pixel in the succession of pixels; 

continuous-tone pattern detecting means for judging 
whether or not the target pixel is in the continuous- 10 
tone region by using an hnage signal which repre- 
sents a second vicinity of the image which contains 
the target pixel; 

continuous-tone smoothing means for smoothing the 
continuous-tone pattern detection state on each 15 
pixel in the succession of pixels; and 

filtering means for filtering the image signal of the 
target pixel on the basis of characteristics in accor- 
dance with either or both of the outputs of the two 
smoothing meansf. 20 

39. The apparatus of claim 38 wherein the smoothing 
means are both counting means. 

40. The apparatus of claim 38 further including bi- 
level-quantizing means responsive to the filtering 
means. 2S 

41. An image processing apparatus according to 
claim 40, wherein the bi-level-quantizing means in- 
cludes a means for bi-level-quantizing the output with a 
fixed threshold and a means for bi-level-quantizing the 
output by using an ordered dither threshold matrix. 30 

42. An image processing apparatus according to 
claim 40, wherein the bi-level-quantizing means in- 
cludes a means for bi-level-quantizing the output by 
using an error diffusion method. 

43. An image processing apparatus according to 35 
claim 40, wherein the bi-level-quantizing means in- 
cludes; 

a register for storing a quantizing error with respect 
to a neighboring pixel; 

a weighting adder adding a predetermined weighting 40 
to a quantizing error, 

a multiplier for multiplying an addition signal by a 
predetermined coefficient of 0 to 1 in accordance 
with the control signal from a region judging an 
controlling circuit; 45 

an adder for adding the output of the weighting adder 
and the output of the multiplier; 

a quantizer for quantizing the output of the adder; 

a re-quantizer for converting the output of the quan- 
tizer into a different level; 50 

a subtracter for subtracting the output of the re-quan- 
tizer from the input of the quantizer so as to gener- 
ate a quantizing error signal; and 



an error memory for temporarily storing the quantiz- 
ing error signal. 

44. An image processing apparatus according to any 
of claims 38 to 43, wherein at least one of the smoothing 
means includes a region judging memory means for 
temporarily storing the pattern detection state so that 
the smoothing means smoothes on the basis of the out- 
put of the region judging memory means. 

45. An image processing apparatus according to 
claim 38, wherein the screened-halftone pattern detect- 
ing means includes: 

a maximum luminance detector for obtaining the 
maximum luminance in a decision pixel block; 

a minimum luminance detector for obtaining the min- 
imum luminance in the decision pixel block; 

an average luminance detector for obtaining the aver- 
age luminance in the decision pixel block; 

a subtracter for obtaining the difference between the 
maximum luminance and the mmimnrri luminance; 

a comparator for comparing the luminance of each 
pixel with the average luminance; 

a comparison result register for temporarily storing 
the output of the comparator; and 

a screened-halftone pattern detector for detecting a 
screened-halftone pattern from the output of the 
subtracter and the output of the comparison result 
register. 

46. An image processing apparatus according to 
claim 38, wherein the continuous-tone pattern detecting 
means includes: 

a maximum luminance detector for obtaining the 
maximum luminance in a decision pixel block; 

a minimum Imninance detector for obtaining the min- 
imum luminance in the decision pixel block; 

an average luminance detector for obtaining the aver- 
age luminance in the decision pixel block; 

a subtracter for obtaining the difference between the 
maximum luminance and the minimnm luminance; 
and 

a continuous-tone pattern detector for detecting a 
continuous-tone pattern on the basis of the outputs 
of the maximum luminance detector, the minimnnn 
luminance detector and the subtracter. 

47. An image processing apparatus according to 
claim 38, wherein the screened-halftone pattern detect- 
ing means and the continuous-tone pattern detecting 
means include in common a maximum luminance detec- 
tor for obtaining the maximum luminance in a decision 
pixel block, a minimum luminance detector for obtain- 
ing the minimum luminance in the decision pixel block 
and a subtracter for obtaining the difference between 
the maximum luminance and the minimum luminance. 
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